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Singular Combinatorics 



Philippe Flajolet^ 



Abstract 

Combinatorial enumeration leads to counting generating functions pre- 
senting a wide variety of analytic types. Properties of generating functions at 
singularities encode valuable information regarding asymptotic counting and 
limit probability distributions present in large random structures. "Singular- 
ity analysis" reviewed here provides constructive estimates that are applicable 
in several areas of combinatorics. It constitutes a complex-analytic Tauberian 
procedure by which combinatorial constructions and asymptotic-probabilistic 
laws can be systematically related. 
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1. Introduction 

Large random combinatorial structures tend to exhibit great statistical reg- 
ularity. For instance, an overwhelming proportion of the graphs of a given large 
size are connected, and a fixed pattern is almost surely contained in a long random 
string, with its number of occurrences satisfying central and local limit laws. The 
objects considered (typically, words, trees, graphs, or permutations) are given by 
construction rules of the kind classically studied by combinatorial analysts via gen- 
erating functions (abbreviated as GFs). A fundamental problem is then to extract 
asymptotic information on coefficients of a GF either explicitly given by a formula 
or implicitly determined by a functional equation. In the univariate case, asymp- 
totic counting estimates are derived; in the multivariate case, moments and limit 
probability laws of characteristic parameters will be obtained. 
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In what follows, given a combinatorial class C, we let C n denote the number 
of objects in C of size n and introduce the ordinary and exponential GF (OGF, egf), 

OGF: C{z) := C nZ n , egf: C(z) := ^ C n — . 

n>0 n>0 

Generally, egfs and OGFs serve for the enumeration of labelled classes (atoms com- 
posing objects are distinguished by labels) and unlabelled classes, respectively. One 
writes C„ = [z n ]C(z) — n\ [z n ] C(z), with [z™](-) the coefficient extractor. 

General rules for deriving GFs from combinatorial specifications have been 
widely developed by various schools starting from the 1970's and these lie at the 
heart of contemporary combinatorial analysis. They are excellently surveyed in 
books of Foata & Schiitzenberger (1970), Comtet (1974), Goulden & Jackson (1983), 
Stanley (1986, 1998), Bergeron, Labelle & Leroux (1998). We shall retain here the 
following simplified scheme relating combinatorial constructions and operations over 
GFs: 



Construction 


Labelled case Unlabelled case 


Disjoint union T + Q 
Product TxQ,T-kQ 
Sequence ©{-^1 
Set <P{JF} 
Cycle <L{T} 


f(z) + g(z) f(z)+g(z) 
f{z)-g(z) f(z)-g(z) 
(l-f(z)))' 1 (l-f(z)))- 1 
exp(/(z)) exp(/( Z ) + I/(z 2 ) + ---) 
log(l - /(a))" 1 log(l - fiz))- 1 + ■ ■ ■ 



Such operations on GFs yield a wide variety of analytic functions, either given 
explicitly or as solutions to functional equations in the case of recursively defined 
classes. It is precisely the goal of singularity analysis to provide means for extracting 
asymptotic informations. What we termed "singular combinatorics" aims at relat- 
ing combinatorial form and asymptotic-probabilistic form by exploiting complex- 
analytic properties of generating functions. Classical approaches are Tauberian 
theory and Darboux's method, an offspring of elementary Fourier analysis largely 
developed by Polya for his programme of combinatorial chemistry ^7j. The path 
followed here, called "singularity analysis" after 7 , consists in developing a system- 
atic correspondence between the local behaviour of a function near its singularities 
and the asymptotic form of its coefficients. (An excellent survey of central aspects 
of the theory is offered by Odlyzko in |15|.1 



2. Basic singularity analysis 

Perhaps the simplest coefficient estimate is [z"](l — z)~ a ~ n a ~ 1 /T(a), a 
consequence of the binomial expansion and Stirling's formula. For the basic scale 

a Q , /3 (z) = (l-z)-«Qlog(l-z)- 1 
much more is available and one has a fundamental translation mechanism 0: 
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Figure 1: The Hankel contours, Ti and Ti{d), and a A-domain. 



Theorem 1 (Coefficients of the basic scale) For a 6 C\Z<o, j3 € C, one has 

~ ^-(lognf. (2.1) 

n— «x> 1(a) 

Proof. The estimate is derived starting from Cauchy's coefficient formula, 

instantiated with / = a a ^. The idea is then to select for 7 a contour Ti that is of 
Hankel type and follows the half-line (1, +00) at distance exactly 1/n (Fig.^J. This 
superficially resembles a saddle-point contour, but with the integral normalizing to 
Hankel's representation of the Gamma function, hence the factor r(a) _1 . □ 

The method of proof is very flexible: it applies for instance to iterated logarithmic 
terms (log log) while providing full asymptotic expansions; see jZj for details. 

A remarkable fact, illustrated by Theorem ^ is that larger functions near 
the singularity z = 1 give rise to larger coefficients as n — > 00. This is a general 
phenomenon under some suitable auxiliary conditions, expressed here in terms of 
analytic continuation: a A-domain is an indented disc defined by (r > 1, < 7r/2) 

A(tf, r) := { z I \z\ < r, d < Arg(z - 1) < 2tt - 1?, z^l} . 

Theorem 2 (O-transfer) With f(z) continuable to a A-domain and a £ Z<o-' 

f(z) = 0(a a Az)) =► \z n ]f{z) = 0{[z n ]a a ,p{z)). 

Proof. In Cauchy's coefficient formula, adopt an integration contour 7i(??) passing 
at distance 1 /n left of the singularity z = 1 , then escaping outside of the unit disc 
within A. Upon setting z = 1 +t/n, careful approximations yield the result [J]. □ 

This theorem allows one to transfer error terms in the asymptotic expansion 
of a function at its singularity (here z = 1) to asymptotics of the coefficients. The 
Hankel contour technique is quite versatile and a statement similar to Theorem [21 
holds with o(-)-conditions. replacing 0(-)-conditions. The case of a being a nega- 
tive integer is covered by minor adjustments due to l/r(a) = 0; see [Jj. In concrete 
terms: Hankel contours combined with Cauchy coefficient integrals accurately "cap- 
ture" the singular behaviour of a function. 
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By Theorems ^ and |5J whenever a function admits an asymptotic expansion 
near z = 1 in the basic scale, one has the implication, with a >~ r >~ . . . y uj, 

f(z) = Xa(z) + fir(z) H h 0{u(z)) =*> /„ = \a n + fxr n H h 0(w n ), 

where /„ = [z n ]f(z). In other words, a dictionary translates singular expansions 
of functions into the asymptotic forms of coefficients. Analytic continuation and 
validity of functions' expansions outside of the unit circle is a logical necessity, but 
once granted, application of the method becomes quite mechanical. 

For combinatorics, singularities need not be placed at z = 1. But since 
[z n ]f(z) = p~ n [z n ]f(zp), the dictionary can be used for (dominant) singularities 
that lie anywhere in the complex plane. The case of finitely many dominant sin- 
gularities can also be dealt with (via composite Hankel contours) to the effect that 
the translations of local singular expansions get composed additively. In summary 
one has from function to coefficients: 



location+nature of singularity (fn.) => exponential+polynomial asymptotics (coeff.) 



Example 1. 2-Regular graphs (Comtet, 1974). The class Q of (labelled) 2-regular graphs 
can be specified as sets of unordered cycles each of length at least 3. Symbolically: 

1 ~ (\ , ? r 2 \ p -z/2-^/4 

Q = ¥{~£>3{Z}} so that G(z)=exp -log(l-z)- 1 



2~^ L ~ JJ -ry2~»^ ' 2 47 JT— Z 

Z represents a single atomic node. The function G(z) is singular at z — 1, and 



G(z) ~ e-'^il-z) 

z— >i ri\ n— »oo yjixn 

This example can be alternatively treated by Darboux's method. □ 

Example 2. The diversity index of a tree (Flajolet, Sipala & Steyaert, 1990) is the number 
of non- isomorphic terminal subtrees, a quantity also equal to the size of maximally compact 
representation of the tree as a directed acyclic graph and related to common subexpression 
sharing in computer science applications. The mean index of a random binary tree of 
size 2n + 1 is asymptotic to Cn/^/\og n, where C = \J 8 log 2/ir. This results from an exact 
GF obtained by inclusion-exclusion: 

k(z) 4E^t (?) ( vd-im^r _ yr-ii 

k>o \ / 

Singularities accumulate geometrically to the right of 1/4 while K(z) is A-continuable. 
The unusual singularity type {l/^/X log X) precludes the use of Darboux's method. □ 

Rules like those of Table (|1.1() preserve analyticity and analytic continuation. 
Accordingly, generating functions associated with combinatorial objects described 
by simple construction rules usually have GFs amenable to singularity analysis. The 
method is systematic enough, so that an implementation within computer algebra 
systems is even possible as was first demonstrated by Salvy 18 . 



3. Closure properties 
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In what follows, we say that a function is amenable to singularity analysis, or 
"0/ S.A. type" for short, if it is A-continuable and admits there a singular expansion 
in the scale S = {a a ,r(z)}. First, functions of S.A. type include polylogarithms: 

Theorem 3 The generalized polylogarithms Li a ,k are of S.A. type, where lA a ^ k {z) := 
E„>i(logn) fe n-^", fceZ> . ' 

The proof makes use of the Lindclof representation 

-, ,-1/2+oc 

J2 <t>(n)(-z) n =-7^ 4>{s)z s -. da, 

2Z7T A/2-oo Sln7rs 

in a way already explored by Ford , with Merlin transform techniques providing 
validity of the singular expansion in a A-domain 5 . 

Example 3. Entropy computations. The GF of {log(fc!)} is (1 — Lio,i(z), which is of 
S.A. type. The entropy of the binomial distribution, -K n ^ = (J£)p k (l — p) n ~ k , results: 

H n ■= - TTn.fc log 7T n , fc ~ - log U + - + log \/2Tip(l - p) H . 

— ■ n — >oo 2. L 

Such problems are of interest in information theory, where redundancy estimates 
precisely depend on higher order asymptotic properties (Jacquet-Szpankowski, 1998). Full 
expansions for functionals of the Bernoulli distribution are also obtained systematically pjj- 
□ 

As it is well-known, asymptotic expansions can be integrated while differen- 
tiation of asymptotic expansions is permissible for functions analytic in sectors: 



Theorem 4 Functions of S.A. type are closed under differentiation and integration. 

Finally, the Hadamard product of two series, / g is defined as the termwise 
product: f(z)Qg(z) = J2 n fn9nZ n , if f(z) = £„ f n z n , g{z) = f n z n . Hadamard 
(1898) proved that singularities get composed multiplicatively. Finer composition 
properties 0] result from an adaptation of Hankel contours to Hadamard's formula 

Theorem 5 Functions of S.A. type are closed under Hadamard product. 

Example 4. Divide- and- conquer algorithms solve recursively a problem of size n by split- 
ting it into two subproblems and recombining the partial solutions. Under the assumption 
of randomness preservation, the expected costs f n satisfy a "tree recurrence" of the form 

fn = tn + ^ ^n,k (fk + fn-k-a) , a G {0, 1}, 

k 

where the "toll" sequence t n usually has a simple form (e.g., n^logn) and the ir n ,k char- 
acterize the stochastic splitting process. The corresponding GFs then satisfy an equa- 
tion f(z) — t(z) + C[f](z), where the linear operator C reflects the splitting proba- 
bilities. For instance, binary search trees and the Quicksort algorithm have C[f(z)] = 
2 f f(x)dx/(l — x). One then has in operator notation f(z) — (I — C)~ \t](z), where the 
quasi- inverse acts as a "singularity transformer". Closure theorems allow for an asymp- 
totic classification of the cost functions induced by various tolls under various probabilistic 
models mirrored by the splitting probabilities □ 
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4. Functional equations 

Algebraic functions have expansions at singularities that are expressed by frac- 
tional power series (Newton-Puiseux) . Consequently, they are of S.A. type with 
rational exponents; accordingly their coefficient expansions are linear combinations 
of algebraic elements of the form uj n n r / s , with u> and algebraic number and r/s e Q. 
By Weierstrass preparation, such properties extend to many implicit GFs. For in- 
stance, GFs of combinatorial families of trees constrained to have degrees in a finite 
set have a branch point of type y/X at their dominant singularity, which in turn cor- 
responds to the "universal" asymptotic form T n ~ cu> n n~ 3 / 2 for coefficients (Polya, 
1937; Otter 1948; Meir-Moon, 1978). 

Order constraints in labelled classes are known to correspond to integral oper- 
ators and, in the recursive case, there result GFs determined by ordinary differential 
equations. Furthermore, moments (i.e., cumulative values) of additive functionals of 
combinatorial structures defined by recursion and order constraints have GFs that 
satisfy linear differential equations, for which there is a well-established classifica- 
tion theory going back to the nineteenth century. In particular, in the Fuchsian 
case, singularity analysis applies unconditionally, so that the resulting coefficient 
estimates are linear combinations of terms oj n n a (\ogn) k , with u,a algebraic and 
k £ Z>o- This covers a large subset of the class of "holonomic" functions, of which 
Zeilberger has extensively demonstrated the expressive power in combinatorial anal- 
ysis 

Example 5. Quadtrees are a way to superimpose a hierarchical partitioning on sequences 
of points in d-dimensional space: the first point is taken as the root of the tree and 
it partitions the whole space in 2 d orthants in which successive points are placed and 
then made to refine the partition 13 . The problem is expressed by a linear differential 
equation with coefficients in C(z). The average cost of finding a point knowing only k of 
its coordinates is of the asymptotic form cn a with a — a(k,d) an algebraic number of 
degree d. For instance k — 1 and d = 2 yield a solution involving a hypergeometric 
function as well as a — (\/T7 — 3)/2 = 0.56155, in contrast to an exponent ~ that would 
correspond to a perfect partitioning, i.e., a regular grid (Flajolet, Gonnet, Puech & Robson, 
1993). □ 

Substitution equations correspond to "balanced structures" of combinatorics. 
An important role in the development of the theory has been played by Odlyzko's 
analysis Jl] of 2-3 trees (such trees have internal nodes of degree 2 and 3 only and 
leaves are all at the same depth). The OGF satisfies the equation T(z) = z+T(t(z)), 
with t(z) := z 2 + z 3 , and has a singularity at z = 1/0, a fixed point of t, (0 = 
(l + VS)/2). The singular expansion involves periodic oscillations, corresponding to 
infinitely many singular exponents having a common real part. Singularity analysis 
extends to this case and the number of balanced 2-3 trees is found to be of the form 
Tn ~ r0 n fi(logn), for some nonconstant smooth periodic function f2. 

A similar problem of singular iteration arises in the analysis of the height of 
binary trees UJ. The GF yh(z) of trees of height at most h satisfies the Mandelbrot 
recurrence yu = z + y 2 ^-^, with yo = z. The fixed point is the GF of binary trees, that 
is, of Catalan numbers, j/oo = (1 — yT — Az)/2 which has its dominant singularity 
at 1/4. The analysis of moments of the distribution of height turns out to be 
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equivalent to developing uniform approximations to yn{z) as z — > 1/4 and h — > oo 
simultaneously, this for z in a A-domain. The end result, by singularity analysis 
and the moment method, is: the height of a random binary tree with n external 
nodes when normalized by a factor of l/(2y / n) converges in distribution to a theta 
law defined by the density 4x^ fc>1 k 2 (2k 2 x2 — 3)e _fc x . The result extends to all 
simple families of trees in the sense of Meir and Moon and it provides pointwise 
estimates of the proportion of trees of given height, that is, a local limit law. 

Generalized digital trees (Flajolet & Richmond, 1992) correspond to a differ- 
ence differential equation, d^ip(z) = t(z)+2e z ^ 2 ip(z/2), whose solution involves basic 
hypergeometric functions. Catalan sums of the form ^ fc ( n "^)v(k), with v an arith- 
metical function, arise in the statistics of "order" (also known as Horton-Strahlcr 
number) of trees (Flajolet & Prodinger, 1986). Both cases are first subjected to a 
Mcllin transform analysis, which provides the relevant singular expansions. Peri- 
odic fluctuations similar to the case of balanced trees then result from singularity 
analysis. 

A notable parallel to the paradigm of generating functions and singularity 
analysis has been developed by Vallee in a series of papers. In her framework, 
singularities of certain transfer operators (of Ruelle type) replace singularities of 
generating functions. See, e.g., |^ for applications to Euclidean algorithms 
and statistics on sequences produced by a general model of dynamical sources. 

5. Limit laws 

One of the important features of singularity analysis, in contrast with Dar- 
boux's method or (real) Tauberian theory, is to allow for uniform estimates. This 
makes it possible to analyse asymptotically coefficients of multivariate generating 
functions, f(z,u), where the auxiliary variable u marks some combinatorial param- 
eter x- One first proceeds to extract f n (u) := [z n ]f{z,u) by considering f(z,u) as 
a parameterized family of univariate GFs to which singularity analysis is applied. 
(The coefficients /„ (it) are, up to normalization, probability generating functions of 
X-) A second level of inversion is then achieved by the standard continuity theorems 
for probability characteristic functions (equivalently Fourier transforms). Techni- 
cally, consideration of a (small) neighbourhood of u = 1 is normally sufficient for 
extracting central limit laws. 

Two important cases are those of a smoothly varying singularity and of a 
smoothly varying exponent. In the first case, f(z,u) has a constant singular ex- 
ponent ao and one has f(z,u) ~ c(u)(l — zj p(u))~ a ° . Then, uniformity of singu- 
larity analysis implies the estimate /„(«,) //„(1) ~ (p(l) / p(u)) n . In other words, 
the probability generating function of \ over objects of size n is analytically sim- 
ilar to the GF of a sum of independent random variables — this situation is de- 
scribed as a "quasi-powers" approximation. A Gaussian limit law for \ results 
from the continuity theorem, with mean and variance that grow in proportion to n. 
The other case of a smoothly varying exponent is dealt with similarly: one has 
f(z,u) ~ c(w)(l — z/p)~ a ^ implying / n (u)// n (l) ~ n a ^~ a ^; this is once more a 
quasi-power approximation, but with the parameter now in the scale of log n. (See 
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Gao & Richmond, 1992, for hybrid cases.) 

The technology above builds on early works of Bender [Q, continued by Flajo- 
let & Soria [SUEli and H. K. Hwang [IT]. In particular, under general conditions, 
the following hold: a local limit law expresses convergence to the Gaussian density; 
speed of convergence estimates result from the Berry-Esseen inequalities; large de- 
viation estimates derive from singularity analysis applied at fixed real values 1. 

Example 6. Polynomials over finite fields. Consider the family V of all polynomials 
with coefficients in the Galois field ¥ q . A polynomial being determined by its sequence 
of coefficients, the GF P(z) of all polynomials has a polar singularity. Furthermore, the 
unique factorization property implies that V is isomorphic to the class of all multisets 
(9JI) of the irreducible polynomials T: V — 9Jt{X}. Since taking multisets corresponds 
to exponentiating singularities of GFs, the singularity of the GF I(z) is logarithmic. By 
singularity analysis, the number of irreducible polynomials is asymptotic to q n /n — this 
is an analogue of the prime number theorem, which was already known to Gaufi. The 
bivariate GF of the number of irreducible factors in polynomials turns out to be of the 
singular type (1 — qz)~ u , with a smooth variable exponent, so that: the number of irre- 
ducible factors of a random polynomial over ¥ q is asymptotically Gaussian. This parallels 
the Erdos-Kac theorem for integers. Similar developments lead to a complete analysis of 
a major polynomial factorization algorithm (Flajolet, Gourdon & Panario, 2001). □ 

Movable singularities and exponents occur frequently in the analysis of pa- 
rameters defined by recursion, leading to algebraic or differential equations, which 
"normally" admit a smooth perturbative analysis. 

Example 7. Patterns in random strings. Let Q be the total number of occurrences of a 
fixed pattern (as a contiguous block) in a random string over a finite alphabet. For either 
the Bernoulli model, where letters are independently identically distributed, or the Markov 
model, the bivariate GF, with z marking the length of the random string and u the number 
Q. of occurrences, is a rational function, as it corresponds to a finite-state device. Perron- 
Frobenius properties apply for positive u. Therefore the bivariate GF viewed as a function 
of z has a simple dominant pole at some p(u) that is an algebraic (and holomorphic) 
function of u, for it > 0. Quasi-powers approximations therefore hold and the limit law of 
Q. in random strings of length n is Gaussian. Such facts holds for very general notions of 
patterns and are developed systematically in Szpankowski's book |2(J| . □ 

Example 8. Non-crossing graphs. Consider graphs with vertex set the nth roots of unity, 
constrained to have only non-crossing edges; let the parameter \ be the number of con- 
nected components. The bivariate GF G(z,u) is an algebraic function satisfying 

G 3 + (2w 3 z 2 - 3w 2 z + w- 3)G 2 + {3w 2 z - 2w + 3)G + w - 1 = 0. 

G(z, 1) has a dominant singularity at p(l) = 3/2 — v2 which gets smoothly perturbed 
to p(u) for it near 1. The singularity type is consistently of the form (1 — z / 'p(u)) 1 ^ 2 . 
A central limit law results for the number of components in such graphs (Flajolet-Noy, 
1999). Drmota has given general conditions ensuring Gaussian laws for problems similarly 
modelled by multivariate algebraic functions 0- O 

Example 9. Profile of quadtrees. Refer to Example The bivariate GF f{z,u) of node 
levels in quadtrees satisfies an equation, which, for dimension d — 3 reads 

f(Z,U) = l + 2u r/ r f(X 3 ,u)- . 

J Xl(l-Xl)J X 2 {1-X 2 )J 1-X 3 

This corresponds to a linear differential equation with coefficients in C(z,u) and a fixed 
singularity at z = 1. The indicial equation is an algebraic one parameterized by u and, 
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when u « 1, there is a unique largest branch a(u) that determines the dominant regime of 
the form (1 - z)"^"' . This is the case of a movable exponent inducing a central limit law: 
The level profile of a d-dimensional quadtree is asymptotically Gaussian. Such properties 
are expected in general for models that are perturbations of linear differential equations 
with a fixed Fuchsian singularity (Flajolet & Lafforgue, 1994). □ 

Finally, singularity analysis also intervenes by making it possible to "pump" 
moments of combinatorial distributions. Examples include the height of trees dis- 
cussed earlier, as well as tree path length (Louchard 1983, Takacs 1991) and the 
construction cost of hashing tables (Flajolet, Poblete & Viola, 1998). The latter 
problems were first shown in this way to converge to Brownian Excursion Area. 

6. Conclusions 

Elementary combinatorial structures are enumerated by generating functions 
that satisfy a rich variety of functional relations. However, the singular types that 
are observed are usually somewhat restricted, and driven by combinatorics. In 
simpler cases, the generating functions are explicit combinations of a standard set 
of special functions. Next, implicitly defined functions (associated with recursion) 
have singularities that arise from failures of the implicit function theorem and are 
consequently of the algebraic type, often with exponent ^ . Linear differential equa- 
tions have a well-established classification theory that, in the Fuchsian case, leads 
to algebraic-logarithmic singularities. In all such cases, the singular expansion is 
known to be valid outside of the original disc of convergence of the generating func- 
tion. This means that singularity analysis is automatically applicable, and precise 
asymptotic expansions of coefficients result. 

Parameters of combinatorial structures, provided they remain "simple" enough, 
lead to local deformations (via an auxiliary variable u considered near 1) of the 
functional relations defining univariate counting generating functions. Under fairly 
general conditions, such deformations are amenable to perturbation theory and ad- 
mit of uniform expansions near singularities. Then, since the singularity analysis 
process preserves uniformity, limit laws result via the continuity theorem for char- 
acteristic functions. In this way, the behaviour of a large number of parameters of 
elementary combinatorial structures becomes predictable. (The theory of functions 
of several complex variables is thus bypassed. See Pemantle's recent work JS] based 
on this theory for a global characterization of all the asymptotic regimes involved.) 

The generality of the singular approach makes it even possible to discuss com- 
binatorial schemas at a fair level of generality [5] 1111 119j , the case of polynomial 
factorization (Ex. [SJ being typical. Roughly, combinatorial constructions viewed 
as "singularity transformers" dictate asymptotic regimes and probabilistic laws. 
Analytic combinatorics then represents an attractive alternative to probabilistic 
methods, whenever a strong analytic structure is present — this is the case for most 
combinatorial problems that are "decomposable" and amenable to the generating 
function methodology. Very precise asymptotic information on the randomness 
properties of large random combinatorial objects results from there. This in turn 
has useful implications in the analysis of many fundamental algorithms and data 
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structures of computer science, following the steps of Knuth's pioneering works |12|. 
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